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Abstract 

The aim of this paper is to study the asymptotic behavior of strongly reinforced 
interacting urns with partial memory sharing. The reinforcement mechanism con- 
sidered is as follows: draw at each step and for each urn a white or black ball from 
either all the urns combined (with probability p) or the urn alone (with probability 
1 — p) and add a new ball of the same color to this urn. The probability of drawing 
a ball of a certain color is proportional to Wk where k is the number of balls of 
this color. The higher the p, the more memory is shared between the urns. The 
main results can be informally stated as follows: in the exponential case Wk - p k , if 
p > 1/2 then all the urns draw the same color after a finite time, and if p < 1/2 then 
some urns fixate on a unique color and others keep drawing both black and white 
balls. 



1 Introduction 

Assume that we are given U urns, where U e N. To each urn give a unique label in 
{ 1 ,...,£/} , and refer to the urn labeled by u as the "urn u" . Assume we are given in ad- 
dition a reinforcement weight sequence (wi) ieNU { } e R + Nu '^, and an interaction parameter 
pe[0,l]. 

Consider the following model: 

- At time n = 0, all the urns are empty; 



1 2 3 U-l U 

Figure 1: At n = all the U urns are empty. 



- At time n each of the U urns contains exactly n balls. The balls are either black or 
white. The next figure is an illustration corresponding to time n = 3: 
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1 2 3 U-l U 

Figure 2: At n = 3 each urn contains 3 balls. 



Let us denote by B™ and W™, respectively, the number of black and white balls in the 
urn u at time n. Therefore B* := Y, u (resp. W* := £ n ) is the total number of black 
(resp. white) balls in the system at time n. Note that B* + W* = Un. 

Define 7t(i,j) = w w + w . , and note that is the probability of drawing a black ball 

out of an urn containing % + j balls among which i are black, under the reinforcement 
mechanism determined by the weights (tyi)j<= NU {o}- 

- The configuration at time n + 1 is built from that at time n according to the fol- 
lowing transition mechanism: Let ^ be U independent Bernoulli (p) random variables, 
independent from the filtration up to time n. For each u e {1, . . . , U}, 

(a) On = 1}, draw a ball out of all the U urns combined. The color of the drawn 
ball is black with probability ti (B*,W*), and white with probability n (W*,B*); 

(b) On = 0}, draw a ball out of urn u alone, so that the probability of black is 
7T and of white is tt (W^, B%)\ 

(c) record the color of the drawn ball and return it to its urn of origin, and add another 
ball of the same color to urn u. 

Doing the above procedure (a)-(c) simultaneously for each u e {1,...,U}, yields the 
configuration at time n + 1. Call this process the Interacting Urn Mechanism. 

Note that when p = the urns are completely independent, while if p = 1 the system 
behaves just like a single urn model in which U balls are drawn with replacement and U 
new balls that match in color are added in, at each step. 

The special case U = 1 and W{ = 1 + iA was firstly introduced by Polya in 1930 to 
model the spreading of an epidemic (Polya |8J). A number of generalizations have been 
introduced since, concerning the reinforcement sequence, the number of colors or the way 
of replacing balls into the urns. A good introduction about these models can be found in 
a survey by Pemantle [7]. 

An interesting condition to consider about the reinforcement weight sequence is the 
Strong Reinforcement Hypothesis: 

OO 1 

T— <oo. (SRH) 

Define event A := {3iV < oo, such that starting from time N, all the balls drawn 
(added) have the same color}. The strongly reinforced mechanism is interesting due to 
the following result, proved for example in pQ or [7J using Rubin's exponential embedding. 
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Proposition 1.1. IfU = l then 



ftSRH\) o P(A) = 1. 



Remark: It is clear that the value of p has no influence on the dynamics when U = 1. 

It is natural to ask whether the behavior of Proposition 11.11 persists under (ISRHp in 
the general case U > 2 and p e [0, 1]. Though it seems to be a difficult question in the 
general case, we shall study in this paper the case of exponential reinforcement weight 
sequences, that is Wi = p % with p > 1, which is much simpler. 

The main theorem of this paper is the following. 

Theorem 1.2. If the reinforcement weight sequence satisfies liminf j^oo Wi+i/wi > 1 then 

• If p > 1/2 then all the urns eventually fixate on the same color ; 

• if p < 1/2 then there exist a color c such that eventually, some urns fixate on c and 
the other urns draw a ball of color c each time the drawing is done in all the urns 
combined and of the other color each time the drawing is done in the urn alone. 

A more precise statement of these different cases will be given in section 3. In the 
major part of this paper we will limit ourselves to only two colors of balls (black and white) 
and to exponential reinforcement sequences. However we explain in the last section how 
the proofs extend easily to any number of colors and to any reinforcement weight sequence 
that satisfy liminf Wi+i/iUi > 1. 

It is worth noting that Interacting Urn Models is closely linked to multiple particles 
Reinforced Random Walks on star shaped graphs: 



where the number of particles is equal to the number of urns and the number of edges 
is equal to the number of colors. The particles interact by sharing their memory just as 
the urns do. In Reinforced Random Walks, (ISRHj) also plays an important role since this 
is expected to be the condition for the walk getting eventually stuck on one edge. This 
assertion, known as the Sellke conjecture, has been proven in [5] by Limic and Tarres 
for all (tfj)ieNu{o} satisfying an additional technical condition, including nondecreasing 
(wi)imu{o}- in another direction, if the reinforcement is affine, then it was proved by 
Enriquez and Sabot in [3] that some Reinforced Random Walks behave as an annealed 
Random Walk in Dirichlet Environment (see [1]), Merkl and Rolles prove in [6] the re- 
currence of such a walk in the graphs obtained from Z 2 by replacing every edge by a 
sufficiently large, but fixed number of edges in series. In the case of polynomial reinforce- 
ments Toth proved in [U] that there are some limit theorems for weakly reinforced random 
walks on Z. 




Figure 3: A star shaped graph with 8 edges. 
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The rest of the paper is organised as follows. Section 2 introduces all the notations 
and definitions about Urn Paths and Interacting Urn Mechanism. Section 3 is devoted to 
the exponential reinforcement and splits into one subsection about heuristics that shows 
us how a phase transition appears for p = 1/2, and three subsections devoted respectively 
to supercritical, critical and subcritical cases. Section 4 discusses two generalizations of 
the model: the first one shows that our results are still true if the number of colors is 
larger than 2, and the second one extends them to a wider class of reinforcement weight 
sequences. The conclusion provides some open questions about the model. 

2 Definitions 
2.1 Urn Paths 

Denote by U = {1, U} the set of U urn labels, where U e N. Denote by <£ = { b, ro} the 
set of two colors: black (b) and white (tt>). 

Definition 2.1. We call a sequence r = (r n ) neNU { } on Z u an Urn Path if: 

• r = z u, 

• V?ieW,VneN, r n (u) - r n _i{u) e {0, 1}. 

And we denote by 1Z the set of all Urn Paths. 

The coordinates r n (u) of r n should be interpreted as the numbers of black balls in urn 
u at time n. 

Proposition 2.2. If r is an Urn Path, then 

i) VneN,VweW, 0<r n (u)<n; 

ii) s = (n - T n ) neNU { } is also an Urn Path. Its coordinates s n (u) = n-r n (u) should be 
interpreted as the number of white balls in urn u at time n. 

Proof. The proof by induction is immediate from the definition of an Urn Path. □ 

Definition 2.3. Let r e 1Z, u eU, and neNu {0} be a time unit. Let us denote by: 

• c% the color of the ball which is added to the urn u at time n>\: 



• b% the number of black balls in urn u at time n, in symbols = r n (u); 

• w% the number of white balls in urn u at time n, in symbols w% = n - r n (u); 

• b* n the total number of black balls in the U urns at time n: b* n - Eusw^n = Y.u<kU r n{u)\ 




if 
if 



r n (u) 
r n {u) 



r„_i(w) = 1, 
r n -i(u) = 0. 
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u>* the total number of white balls in the U urns at time n: w* = Y, U eU w n = Un 



• m" the majority color in urn u at time n: 



m" 



b 
to 



if 6«>w« 
if 6«<w« 



m* i/ie majority color in the U urns at time n: 



b 
to 



if b* > w* 
if b* < w* 



In case of ties, we choose the black as the majority color, but this is out of convenience 
and it is not really important for the results. 

Sometimes, it will be useful to consider a finer time indexing for which at each step a 
ball is added to only one urn. We will reserve the variable k and a superscript prime for 
this time indexing. In particular, for all n e N u {0} and u e U, we have c' k = c%, b' k = b'%, 
m' k = m^, x' k = and X' k = X% whenever k = k(n, u) - nU + u (x% and X% shall be define 
in the next section). 



n = 



k = l 



k = 2 



k = 3 



k=U-l k=U 



n=l 



O 



O 



k = U + l k = U + 2 k = U + 3 



k=2U-l k =2U 



n = 2 



o' 



o 



o' 



,o 



JO 



k=2U+l k=2U+2 k=2U+3 k=3U-l k=3U 

Figure 4: At time k = nU + u one adds the n-th ball in the urn u. 



2.2 Interacting Urn Models 

Let (Q,A, P) be a probability space on which we define: 

i) a sequence X = (X^) TteN ueW of i.i.d random variables with distribution p5\ + 

ii) a sequence V = (V r f) neN jUe u of i.i.d random variables with uniform distribution on 
[0,1], independent of X. 
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Definition 2.4. Denote by T n the a-field generated by the first n steps, in symbols 

F n = a(X^VZ ueU, \<m<n). 

Fix the reinforcement weight sequence w = (t«i)ieNu{o} e R+ u ^ and recall that 7r(i,j) = 
w + for i,j € N u {0}. Set \ = {-l,+l} WxN and call x = (x™) n&} ,usu e X an environment. 
We next define a process (R n ) n m on Z u such that Ro = z u and e N, Vu € IA: 



if = 1, then: 

.Rn(w) - #n-l(u) 



1 if^<7r(S^ 1 ,W^_ 1 ) J 
ifK"^^,^); 



if 



-1, then: 



# n («) - R n -i(u) 



1 if^<7r(fl^_ 1 ,W^ 1 ) > 

if V«z«(bi. 1 ,wz_ 1 ). 



(★★) 



Note that i? is almost surely an Urn Path. Hence we can define the quantities B%, 
W%, B* and W* for all n > and u e £V as in Definition 12.31 This justifies the use of these 
notations in (Q and (| ■&■&!) . 

We call the law of this process the Interacting Urn Mechanism in the environment x 
and denote it by IUM X . We denote by P x the probability it induces on the set of all Urn 
Paths. 

Now fix the interaction parameter p e [0,1]. If the environment is sampled as a 
sequence (X%) neNtUe u of i.i.d random variables such that: 

p[J^ = l] = l-p[J¥£ = -l]=p, VneN,VweW, 

then this process is called the Interacting Urn Mechanism. We denote its law by IUM, 
and denote by P the probability it induces on the set of all Urn Paths. 

Definition 2.5. Let Q\ be the a-field generated by what happens when the balls are drawn 
out of all the U urns combined, in symbols 

and G-i the a-field generated by what happens when the balls are drawn out of one urn at 
a time, in symbols 

Q-l = °~ ((^Q)neN ,uel(i l{X^=-l})neN,uew) ■ 



3 The exponential reinforcement 

From now on we shall focus on the case where iWj = p l for some p > 1. That is to say the 
exponential IUM that satisfies (ISRHjh 
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The important thing to notice about exponential reinforcement is that the transition 
law depends only on the difference B-W: 



p B 1 

ir(B,W) = 



p B + p w 1 + p w - B ' 
and 

p w 1 



p B + p w 1 + p B - w ' 
3.1 Heuristics 

Let us consider initially the case U = 2 and assume that the probability of drawing a black 
ball out of urn u at time n converges to a limit as n goes to the infinity (which we shall 
prove in the next subsections). Denote this limit by a u : 

a u := lim P (b is drawn out of urn u at time n) , u = 1 or 2. 

n^oo 

Then by a Law of Large Numbers we get: 



B u 

lim — = a u , u = 1 or 2. 

n^oo n 



Thus, 



a u = lim P (b is drawn out of u at time n) = P [c^ = b] 

n->oo 

= lim [p[i; = -i]pK = *\x u n = -l] + p[i; = i]p[c« = b|x« = 1]] 



p S n p B n+ B n 



= jim(l-p) 1 ■ +p : ' 



1 + p n-2BH f I + p 2n-2(B^+Bl) 

= jim(l-p) i ■ } n _ 7 . +P ! 



I + pn{l-2a u ) 1 ^ + p2n(l-a 1 -a 2 ) 
= ( 1 -p) 1 { Qtl >i}+P 1 {a 1+ a 2 >l}- 

This yields the following system of two equations with two variables: 



| ai = (l-p)l {ai> i}+pl {ai+a2>1} , 
{ a 2 = (1-p)1 {q2> ij +pl {ai+a2 >i}- 

There are six possible cases to consider: 

• If ai < 1/2 and a 2 < 1/2 (and therefore ai + a 2 < 1), then the system above gives: 
Oil = «2 = 0. 
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• If ai > 1/2 and a 2 > 1/2 (and therefore a± + a 2 > 1), then the system above gives: 
aii = a 2 = (1 -p) +p = 1. 

• If «i < 1/2, a 2 > 1/2 and a\ + a 2 > 1, then the system above gives: a\ = p and a 2 = 1. 
This well as the next three cases, is clearly possible only if p < 1/2. 

• If ai > 1/2, a 2 < 1/2 and «i + a 2 > 1, then the system above gives: ol\ - 1 and a 2 = p. 

• If ax < 1/2, a 2 > 1/2 and ai + a 2 < 1, then the system above gives: a\ = and 
a 2 = 1-p. 

• If ai > 1/2, a 2 < 1/2 and ai + a 2 < 1, then the system above gives: a.\ = 1 -p and 
a 2 = 0. 

This heuristic indicates that a phase transition occurs at p = 1/2. We obtain the 
following configuration graph: 



a 2 
1 - 



1-p 



P 







P 



1-P 1 



Figure 5: Graph of possible configurations when U = 2. 
The two black points exists for any p e [0, 1], the four gray points exists only for p < 1/2. 



Remark: Note that the solutions are symmetric with respect to the line a\ = a 2 . 
This comes from the fact that inverting the labels of the urns gives a process with the 
same law. Similarly, inverting the two colors is manifested on the graph by a symmetry 
with respect to the point a\ = a 2 = 1/2. (For example, (1 -p, 0) is symmetric to (p, 1)) 

Taking these two transformations into account show us that the two points (0,0) and 
(1, 1) corespond in fact to two similar asymptotic behaviors, and the four points (0, 1-p), 
(p,l), (1 - p, 0) and (l,p) are also similar. In particular, similar points occur with the 
same probability. 

When p > 1/2 we have only two possibilities (black points) and each of them has 
probability 1/2. 

When p < 1/2 we have six possibilities. An interesting question is: what is the respec- 
tive probability of each of the above points? 
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One can object here that we forgot to discuss the case a± = 1/2 or «2 = 1/2. Taking 
this possibility into account yields us to many other points on the configuration graph, 
(in fact, all the points on the lines «i = 1/2 and = 1/2). But since the evolution of the 
process depends only on the differences B% - W%, we can conjecture that the cases when 
cti or ct2 equals to 1/2 will be "unstable solutions". We shall study this in more detail in 
the next subsections. 



3.2 The supercritical case 

In this subsection we consider the case when p > 1/2. We first state a simple but useful 
lemma that is a consequence of the law of large numbers and is left to the reader. 

Lemma 3.1. Let Yi,Y2,Ys . . . be a sequence of i.i.d. random variables such that P[Yi = 
1] = 1 - P[Y"i = -1] = p, then Va e (0,2p- 1), we have: 

p[ri + --- + y fc >aA;,VA;>0] > 0. 

Set 9 P to be the above probability. (Note that 9 P depends on a.) 

Theorem 3.2. Assume that p> 1/2. 

P [3n € N , 3D e £ such that ^n>n ,\/ueU we have c% = 9] = 1 

In words, after some finite time no all the balls drawn have the same color D. 

The theorem is a consequence of the following lemma. 

Recall from Definition 12.51 that Q\ is the cr-field generated by the information of when 
the balls will be drawn out of all the U urns combined {(X^) neNtUin u) and of the parameters 
(V^ l{(x#)=i})neN,«ew that decide what happens when the balls are drawn out of all the U 
urns combined. 

Lemma 3.3. Assume that p > 1/2. There exists a constant r]i> such that for all ni e N ; 



n>ni ualA 



hi 



> rji a.s. 



This means that with a probability uniformly bounded away from 0, the information Qi is 
sufficient to be sure that after time n\, if a ball is drawn out of all the U urns combined 
its color is the majority color at time ni . 



Remark: Note that the event 



n nw=-i} u K=o 

n>ni usU 



is not Qi measurable since for any n and u the event {c^ = tn* } is determined by compar- 
ison of the variable with the variable 7r(5*_ 1 , W*^) which is not ^-measurable (c.f. 
the definition of the IUM.) 
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Proof. Without loss of generality, in this proof we will suppose that the majority color at 
time rii is black, in symbols, = b. 

For all n e N and u e U recall that XL := X% when k = nil + u and set 

Y k = l {X ' k =i} - l{*i=-i}- 
Set ki = (rii + \)U . The sequence Y kl+ i, Y kl+2 , Y kl+3 , ••• satisfies the conditions of Lemma 



13.11 and is independent of T nx . So for all a e (0, 2p - 1) we have: 

p[A\T ni ] = P[A] = 9 p >0, 

where A = {Y kl+1 + --- + Y k > a{k-k x )^k > k x }. Let us fix a = (2p-l)/2 (any a e (0,2p-l) 
would suffice) and set 

7„ = cdJiji-nx - 1) (1) 

and denote by C' k - C% the event 



_ /~1U 



Yn MX^I} < ~ 



Now set 



C = An f| d. 

fc=fci+i 



The proof will proceed in two steps: 
(i) We have the following event inclusion: 



Cc P 



n nw=-i} u w=o^i 

n>ni ueW 



(2) 



(ii) The probability of C knowing T ni is uniformly bounded away from 0: 

P [C|jF n J > r]i a.s. 

It is easy to see that the lemma follows from those two points. Namely, 



n>ni uaii 



0<r /l <P[C|J-„ 1 ]<P 
Let us prove ([!]). First, we prove by induction that: 



T 

•> ni 



a.s. 



cc n nw=-i}uK=m;j. 



Suppose that we know 



N 



n=ni+l 



(3) 
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which means that on C, each time a ball is drawn out of all the U urns combined 
between time n-i + 1 and N, then it is black. So ([3]) gives us: 



N N 

B* N -W* N > (B* ni -W; i ) + £ £ l { x«=i } - E E 1 ^--! 

n=m+l «eW 



2V 



n=ni + l me£Y 
2V 



^ E E Wi - E E 1 «=-i} 

n=ni+l ueW ra=rii+l«eW 
f/(2V+l) 

^ E (^x^i}- 1{X^=-1}) 
fe=fci+l 

f/(2V+l) 

* E n- 

fc=fei+i 



And since C c ^4 by the definition of A for k = U(N + 1): 

B* N -W* N > a(k -h) = a(U(N + 1) - *7(m + 1)) = a[/(iV - m) 



: 72V+1, 



(4) 

recalling (TT]). So for each u eU, using (j2J) with = JV + 1, we deduce that on C, V^ +1 < 
t- sy^r; < — 5* _ w * ; due to dU). Due to the construction of the IUM JW]) the last 

observation means that if = 1 then the ball added to u at time N + 1 is black. 
It follows that 



Cc{X« +1 = -l}u{c^ +1 = m; i = b}, VueU, 
and therefore by induction that 



2V+1 



cc n n«=-i} u R=<}- 

n>ni Met/ 

It remains to note that C is (^-measurable, to conclude: 



C = {p[C|^] = 1}c|p 
which shows ([!]). Let us now prove ([II]). We have 



p[c|^ ni ] = p 



An n 

fe=fei+i 

oo 

!a>< n ^i-^i 



2c=fci+l 



= E 



l A xE 



_fc=fci+l 



\T 

W 1 



"1 



We next give a lower bound for the inside expectation. Fix K > k\ and set N = [-^r-J 
and T* x = a{F ni ;A 1 C' ki+1 ,...,C' K _ 1 ). Then, on A 
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K 



11 ^XF n ,-A 



,k=ki+l 



E i E NK] x n ^K^l 

L k=k 1 +i I J 

= e f e fi {x ^ = _ 1}u{ ^<_i_ } |^] x n 



T ■ A 



where due to the fact that V' K is independent of T m , A, C' k v ..., C' K1 and X' K 



[ 1 {X^=-1MV^< T ^ F }|^] 



Therefore 



= E 




= E 


^{X'k- 


= E 


kx' K =-i} - 


= E 


hx' K =-i} - 


> E 


{\x' K =-i} 


> E 


1 |, 



+ 1; 



' l + p-TJV 



K 



' 1+p-TiV 



"7AT 



if 



,fc=fci+i 



> E 



AT-1 

>< n ^ 



n v. 

fe=fci+i 



7JV 



T ■ 4 

T ■ 4 

^ ni ) ■ ri - 



and by induction we can conclude that 



ft ^'^A 
_k=ki+l 

fc-1 



n 

fc=fcl+l 1 + p 



■7n(fc) 



n i 

=fci+i - 1 



with n(k) = [—J- Since the last inequality is true for any K > h\ we can let K go 
infinity: 



_fc=fcl+l 

Hence we have 



2 n w 

fc=fci+i 1 + p 



-7n(fc) 



n ( 1 , 7n ) ~ Fl ( 1 , a (7n ) 

=ni+l \ 1 + P I n=0 v 1 + P I 
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p[C|F ni ] = E 



1a x E 



T 



_fc=fci+l 



> E 



> E 



> 9 P x 



1 A x 



u 






T 






aUn 1 



n(i +P -^) 



Therefore, setting 



rj 1 = 9 p x 



OO / ^ \U 



we obtain (JD} which gives the lemma. 

Proof, (of Theorem I3.2j) Denote by F ni the event 



K 1 = P 



n nw=-i} u K=<}^ 

n>ni ueiY 



1 • 



Note that (F ni ) ni&l is an increasing sequence of events and let F be the event 

F = lim F ni = (J F ni 



ni—>oQ 



□ 



then recall the Levy 0-1 law (see for example [2]): 

1 F = lim E [lp-l-FnJ = lim P [F\F ni ] > lim P [F ni \F ni ] > rji > a.s. 

Til— *°° ni— >oo m — >oo 

by Lemma [3.31 Therefore P(F) = 1. Denote by the random finite number defined by: 



n nw=-i} u K=<}ft 

n>ni uei^ 



1 . 



n 2 = mm |ni e N : P 

It is important to note here that n 2 is ^-measurable. 

As in the proof of Lemma 13.31 suppose without loss of generality that the above color 
of fixation for the U urns combined is black (b). 

Therefore, for a given e (l/2,p), there is another finite time n$ > n 2 such that, for 
all n>ri3 and uzU, 

B u 
n 

and n3 is ^i-measurable. For example choose 

f ^ wr T!m=n 2 1{X^=1} v „1 

n 3 = mm j n > n 2 : V/ > n, / ^ [ ' 



13 



This minimum exists because 

lim ELn 2 1(^=1} =p>f3 

and it satisfies the expected property: 

Vn > n 3 ^ = ^" t=1 1{c " =b} > 1{c " =b} > ^™ =n2 1{x " =1} > f3 

n n n n 

Now let us bound the expected number of white balls in the urn u as follows: firstly 



ns-l 



E 1 {cs=«} = E 1 {c=»> + E 1 {cs=wi ^ n 3 - 1 + E 



ro} ■ 



n=l 



n=l 



n=n 3 



n=n 3 



and secondly 



E 1 {cS=w] 



n=ri3 



= E 



E 1 {cS=w}n{X-=-l} 

oo 

£ 3 E [ V " > ^^ }1{X " = - 1 ^ 1 ] 

E l W =-i } E[l w> _^ } |^]. 



For the two last steps we use the fact that both n 3 and X% are Q\ measurable. Then, 
since V r f is independent of Q\ on {X% = -1}, we have 



E 1 ^=» Qi 



_n=n z 



~ £ 3 1{X «=- 1}E [^> I ^T)}|^] 
" ^3 1W= " 1} ( 1 "1 + P^- 1) ) 



Ei 



i 



w=-i}" 



1 + ^(2/9-1) 

oo 

- E J ~ n(2/3-l) 



n=n 3 - 1 - ' P 
< OO. 



The above calculation implies that the number of white balls in each urn u is finite 
a.s. This proves the theorem. □ 
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3.3 The critical case 

In this subsection we consider the case p = 1/2. It turns out that in this setting, the 
IUM behave as in the supercritical case. Nonetheless, the argument needs some small 
adaptations. 

In the last argument we use conditioning with respect to Q\ which contains informa- 
tions about the future. In the following proof we will avoid this kind of conditioning with 
respect to the future nonetheless, either method could be used in both settings. 

We first state another consequence to the law of large numbers that is again left to 
the reader, (cf. Lemma [3.11 ) 

Lemma 3.4. Fix v e li. Let Yi, 12,^3, •" be a sequence of independent random variables 
with the following law: 

• if n = v mod U, then P[Y n = 1] = 1, 

• ifnfv mod U, then P[Y n = 1] = l-P[Y n = -1] =p = |. 

Then, 

Vae (0,l/U),P[Vn,Y 1 + - + Y n >an] >0 
Set 9' to be the above probability. (Again 9' depends on the choice of a.) 
Theorem 3.5. Assume that p = 1/2. 

P [3n e N , 3D e £ such that Vn > n , V-u e U we have c" = d] = 1 
In words, all the balls drawn after some finite time n have the same color D. 
For any n € N define the stopping time: 



T n = inf \m>n : VweW, £ X? > 



n , 



Note that (ESn+i^ u i u e M)m>n is a classical random walk on Z u , and that T n is the 
time when this walk enters the domain [n, oo) u so we know that 

T n < oo a.s. 

Before proving Theorem 13.51 we state a lemma. 
Lemma 3.6. Assume that p = 1/2. There exist a constant r]i > such that for all rii e N ; 



nnu^ t^} n {x„« = -in u k = <} 



J" 



> r/! a.s. 



T/iis means that there is a positive probability uniformly bounded away from so that 

• during \ni + l,T ni ] each time a ball is drawn out of the U urns combined, it is of 
the majority color at time n\; 
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• after time T ni , all the balls drawn are of this majority color. 

Proof. Without loss of generality, in this proof we will suppose that the majority color at 
time rix is black, in symbols, = b. 

We first prove that there is a positive probability uniformly bounded away from that 
up to T ni , all the balls drawn out of all the U urns combined are black. The second step 
will be to prove that with a positive probability all the balls drawn after T Ul are black. 

First step: Since b = m* is the majority color at n\ there is at least one urn v e U 
such that its majority color is = b, that is = = b. 

For all n e N and u € U set k = nil + u and 

Y k = \x' k = l}u{u=v} - l{X' k =-l}n{u*v}- 

Set fa - (ni + l)U, the sequence Y kl+1 , Y kl+2 , Y kl+3 , ■■■ satisfies the conditions of Lemma 13.41 
and is independent of J- ni . So for any a e (0, l/U) we have: 

p[A\F ni ]=p[A]=e'>0, 
where A = {Y kl+1 + --- + Y k > a(k - fa), VA; > fa}. Denote by C' k = C% the event 

C' k = C u n = {{X' k = -l}n{u±v})u{c' k = m* ni } 

that is "if the draw for urn u at time n is either out of all the U urns combined or out of 
v then its color is m* . " Then we have: 



n nw=-i}uR=b} 

n=ni+l ueU 



T 



> P 



> P 



> E 



(T"i+l)C7 

n {x>=-i}u{c> k =b} 

fe=fei+i 

(T"i+l)C7 

Pi Cfc 

fe=fel+l 

(T"i+l)(7 

An H C h 

fc=fci+i 

(T n i+l)C7 

1a x EI !q 

fc=fci+i 



T 



T 

J 711 

T 







' (T n i + l)U 








> E 


l A xE 


n 1^ 

k=ki+i 


T ■ A 

J 711 ) ■ rL 




T 

J rti 



We next give a lower bound for the interior expectation. Fix K > fa and set T^ x 
a(J : n - L \A,C' ki+v ...,C' K _ 1 ). Then, on A, we have 





" K 








E 


n lq 


•F n\ j A 


= E 


E 




. k=k\+l 









K-1 



E[l<%|*£] n lq 



•F ni ) 



fc=fei+i 
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where 



Efvl^l = E f 1/, , 1W x s s , \ J-*f 1 , with u = K modU. 



Therefore, on ^4 and n^ fc 1 i+1 C^,, there are three cases to consider. 



I. HX' K = 1: 



= E 



V£<[l+P 



l K —1 i i K —1 i 

L~cH L — it — J -i—i 



T:, 



and on A and nj^ fe i +1 C£, we have: 

b[ w -w* w = B* ni -w; 1+ y, E(i{c^}-i{c^ } ) 



n=ni+l m=1 



L^J u 



* E E( 1 {cs=t»} _1 fe="'}) 

n=ni+l n=l 



^ E E (l{x«=i}u{«=t,} ^ i] v;;= i 

n=ni+l n=l 



l{x«=-i}n{««}) on nf =fc 1 i+1 C(, 



fci+t/CL^J-n-l)) 



EE ^n+u - E ^ 

n=ni+lu=l fc=fci+l 



where the second to last inequality is due to A. Since V' K is independent of we 
deduce that: 



4^1^] > E 



1 {v^<[i+p-"( K - 1 - fc i)] -1 } 

1 



1 + p-cx(K-\-k{) ■ 



2. HX' K = 



-1 and w = v, then 



= E 



= E 



^<ll + p-(^-l-^-l)] _1 jl^ 
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On A and n fcl fc * +1 Cfc, we have: 



K-l 



b^-w^ = B* ni -WZ 1+ £ (l {c , =b} -l {c , =w} ) 

n=rii+l 



> E f 1 ^}- 1 {cX=w}) 
n=ni+l 

- Z! ( 1 {^=i}u{«=t,} - l{x-=-i}n{««}) , on nf =fc 1 i+1 Cfc 



n=ni+l 

> V 1, because -u = v 

n=m+l 

* L^J-m^(^-l-*i) 

> a^-l-jfex), 



where in the last line we use the fact a < jj. Since V' K is independent of ^j^, we 
deduce that: 



v' < i 

K i + p-«(«--i-*i) 

1 



J* 7 



1 + p-a{K-\-k x ) ■ 



3. If = -1 and -u ^ v, then 



*[ic^] = E[1|J*] 

= 1. 



In all the three cases we have: 



fci) ' 



As a conclusion, we have, on the event A: 



K 



,fc=fci+i 



> E 



fe=fci+i 



1 



1 + p -a{K-l-ki) 



fc=fci+l 

I! 1 ^n^A 
,fe=fel+l 
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And then by induction: 



K 



11 ^Fn^A 
_fc=fcl+l 



K-l 



k=k 



K-l-ki | 

FT 1 + p -a(k- kl ) * n l + p -ak ^Yl— p -a! 



Now take K = (T n ^ + l)U,we obtain: 



(T n i+l)U 

n ^ nx -A 

k=ki+l 



-ak ' 



We can now conclude that: 
P 



(T"i + 1)-1 

n n«=-i> u K=b} 

n=ni+l u£U 



in 



> E 



> E 



l A xE 



(T"i + l)C7 
fc=fcl+l 

1 



\T 



in 



k=0 l+ p 



fc=0 1 + P 



2 "'nrr 

; — n -L t 



1 



fc=0 - - P" 

This ends the first step of the argument. 

Second step: Denote by Si the event of the step 1, that is 

Si= n nw=-i> u K=&}- 

n=ni + l ueU 

We now consider the probability that on S±, all the balls drawn after T ni are black. Let 
us first prove that on Si the majority color in each of the U urns at time T ni is black, 
that is 

Vw € U, vcCjm l = = b. 
On Si, for any given aeWwe have: 

r p n l 

B T"i " W T"i = E 1 {il=*} ~~ E 1 {^=»} 
n=l n=l 

= E 1 {c^=b} + E 1 {^=&} ~ E 1 {^=w} _ E 1 {^=«} 
n=l n=n\+l n=l n=n\ 

> 0+ E !{c«=b}-wi- E 1 {c^=w} 

n=m+l n=m 

^pnj r p n l 

> E l{x#=i} ~ E -'-{^n=- 1 } ~ 77,1 ' because we are on Si 

n=ni+l n=7ii 

> E ^n-m 

7J=7ll + l 

> ni-ni by the definition of T™ 1 

> 0. 
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This proves that m^ ni = b. Let us now compute the probability that all the balls drawn 
after T n ^ are black. Take iV > T ni + 1 then 

T n i+N 
n=T n i+lueU 

T n l+N 

= E ' 



= E 



> E 



n n^i 

n=T n i+lueU 
T n i+N-l 

n n i{cs=b> >< e 

n=T n i+l ueW 
T n i+N-l j 

n n i {^=&} x n ; — u^ — ^ — 



r n i +jv 



= b} 



T n i+N- 



i', Si 



J~ n x \S\ 



J~\ m'i S\ 



On Si n C\ZZt";? fWC = b}, we have 



Therefore, 
P 



n=T n i + l ueW 



> E 



1 



( 1 + p-^" 1 ) ) 



T"i+AT-1 

n n i{cs=b> x n 1 - _-Vd 

U [T n i+N-1 

x e n n i{c S =b} 

n=T n i+l ueW 



And then by induction : 



T n i+N 

n nK=f} 

n=T n l + l ueU 



J~ n ,', S\ 



N-i l y 
1 \ u 

n i + j 



Letting N going to the infinity gives us the conclusion of the second step. Set 



^=fin {{" < T 111 } n {X: = -1}} u {cl = b}. 

n>ni uaU 



Therefore we have: 

P[A\F ni ] = E 

= E 

> E 



11 1~[ 1 {{n<T«i}n{X-=-l}}u{c«=b} 
n=ni+l u<d4 



n n i{x S =-i}u{cs=b} x e 

n=ni+l weW 



n n i {cs=i-} 

_ra=T n i+l ueU 

U 



j j 



n n i{x«=-i}u{c«=b} x n t— ^ 



by step 2, 



u 



rn— p ~ k « -) bystepl. 

fc=0 1 + P \„-n 1 + P I 



1 + P~ 
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Hence we obtain Lemma 13.61 with 



l — n J- 



>0. 



□ 



Proof, (of Theorem 13. 5p Set 



Then: 



F= U U PI n({^ ni WX« = -l})uK = c}. 

ce{b,w} nieN n>n\ unU 



If = lim P > lim P [F n ,\ F ni ] > r/i > a.s. 



by Lemma [3.61 Therefore P(F) = 1. So almost surely, there exits rti such that 

\/n>T n \\/ueU, C = ml 1 . 
To obtain Theorem 13.51 just set d = m* and n = T Ul + 1. □ 

3.4 The subcritical case 

In this subsection we consider the case when p < 1/2. Note that if p = then the urns 
are independent, so each of them chooses a color with probability 1/2 and draws only 
this color after a finite time. Hence in this part we will only study the interesting case 
< p < 1/2. One can still remark that Theorem 13 . 101 is true for p = as a degenerated 
case. 

Definition 3.7. Given x e x an environment, an Urn Path is said to be x-suitable if there 
exist a color and a finite time no such that for each u eU: 

• either for all n > no, c™ = d, 

• or for all n > n Q , c™ = d each time x™ = 1 and c™ + each time x™ = -1. 

We call conformist urns the urns which satisfy the first condition and nonconformist urns 
the urns which satisfy the second condition. Then denote by N c the number of conformist 
urns and by = U - N c the number of nonconformist urns. 

If x draw as a sequence of independent Bernoulli variables of parameter p, a x-suitable 
Urn Path can be schematically represented as follows: 



1-pj 
p{ 



conformist urns 



iiii 



nonconformist urns 



Figure 6: Schematic representation of an x-suitable Urn Path. 
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Definition 3.8. (Conformism Equation) Suppose that for some x e x, the IUM X is x- 
suitable almost surely, then it is said to satisfy the Conformism Equation if: 

(l-p)J^<|. (CE) 

Note that if x is drawn as a sequence of independent Bernoulli variables of parameter 
p, then almost surely, the asymptotic proportion of the color from Definition 13.71 is 

lm fl. _ N^N^ __ (U-N^pN, __ l _ (1- m > 1 under 
n^oo jj n Un U U 2 

where .D* is the total number of balls of color d in the U urns combined at time n. 

Proposition 3.9. For almost every environment x , if r is an x-suitable Urn Path which 
satisfies /ICE]) , then 

P x [r] > 0. 

Proof. Let x be an environment that is sampled as a sequence (3^)neN,«ew of i.i.d random 
variables such that 

V[xl = 1] = 1 - P[x% = -1] = p, Vn e N , Vw e hi. 
Then x almost surely satisfies: 

V n 1 

Vne^, lim U - x {xl ~- l} =p, (5) 

or equivalently 

V n 1 

V^€ZY, lim L ^ =l-p. (6) 

n->oo 77, 

Now, let r be a deterministic x-suitable IUM which satisfies (ICE)) and set and no as in 
Definition 13.71 and denote by a\ (resp. c?*) the number of balls of color in urn u at time 
n (resp. in all the urns at time n). Then 

< = iV c + pi^ = U-Nt + pN^ = _ (l-p)Nt 1 
n [/ [/ C7 > 2' 



due to (ICE)) . For each conformist urn it, 



lim ^ = 1, 

n->oo 72 



and for each nonconformist urn it: 



.. n-d« 1 
lim = 1 - p > - . 

n^oo n 2 

Fix j3 € (l/2,min{l -p, 1 - (1 -p)NjU}). There exist a time rii > no such that for all 
n>ni. 
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Un 



— > 8 for each conformist urn u, 

n 1 ' 



- > (3 for each nonconformist urn u. 



Let R be an IUM X . Then 



P*[R = r] = E»[l {R=r} ], 
= E»[E»[l {(Rn: 



)o<n<n 1 — (?* n)o<n<n 1 } 



]■ 



Fix N >ni then on {{R n )o<n< ni = (r n ) < n < ni } we have: 



E a 



N 



EI 1 {«u=r„} 
n=ni+l 



JV-1 



n=ni+l 



And on {(i?„) <n<v-i = (r„) < ri <Ar-i} we have 



u<iU 



{R N (u)=r N (u)} 



where 



E X [l{R N (u)=r N (u)}\^N-l] ~ 



1 



1+p 



u(N-iy2d* N _ 1 



if — 1, 

if = -1 and u is conformist, 
if = -1 and -u is nonconformist. 



Therefore 



-l)+2^-i 



^[l{^(«)=r^( U )}|-^V-l] > min | - - ^^yu^ , ~ ~ > J + p - (JV -: 

/ 1 1 1 \ 

> min I I 

V 1 + pU(N-l){l-2p) ' ! + p (AT-l)(l-2£) ' ! + p (JV-l) (1-2/3) / 



1 + p (iV-l)(l-2/3) • 



By induction it follows that: 



N 



EI 1 {«n=r„} 
n=ni+l 



E x 

Let iV go to infinity. 



T 



- JL ( i + PL*-™-™ ) - 5 ( i + ) 



EI 1 {^n=r„} 
n=ni+l 
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Set rj = P x [(R n )o<n< ni = (r„) < n <ni] > then we have: 



00/ 1 \U 



n=0 V J- T P 

which is positive and this proves the proposition. 



□ 



Theorem 3.10. Assume thatp < 1/2, then forP-a.e. x sampled as a sequence (x^) nmjUe u 
of i.i.d random variables such that P[x% = 1] = 1 - P[x™ = -1] = p we have: 

P x [The IUM X is x-suitable and satisfies liCE\) ] = 1. 

Remark: Note that in the critical and supercritical cases we also obtain x-suitables IUMs. 
They satisfy ICEI since there are no nonconformist urns. But in those cases, Proposition 
13.91 is false since x-suitable Urn Paths with Ni > do not occur a.s. 
Before we prove the theorem, let us state a lemma: 

Lemma 3.11. Assume that p < 1/2 and fix u^U. There exist a constant 771 > such that 
for all n\ e N, 



n =i>u 



n>ni 



1 



> rji a.s. 



This means that with a probability uniformly bounded away from 0, the information is 
sufficient to be sure that after time ri\, if a ball is drawn out of the urn u alone, its color 
is the majority color of u at time ri\ . 

This lemma is to be compared with Lemma 13.31 The argument is almost identical, 
just replacing p by 1 -p, Q\ by Q_i, and the balls drawn out of all the U urns combined 
by the balls drawn out of urn u alone. The proof is left to the reader. 

We can now deal with the proof of Theorem 13.101 

Proof. For each « in W, denote by F% 1 the event: 



n w=i} u K=o 



n>ni 



Then (F^)^^ is an increasing sequence of events, and let F u be its limit 

F u = lim 2%=U*£. 



Tlx— >oo 
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Thus 



l F u = lim E [>«|;F m ] = lim P [F u \T ni ] > lim P [F^ ni ] > rfr > a.s. 



by Lemma EU Therefore P [F u ] = 1 and P [C\ U eu F u ] = 1. 
Denote by 712 the finite random number defined by: 



77-2 = min < 774 € N : happens )• . 
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Note that n 2 is <?_i-measurable so it depends on a part of the future but is still 
independent of V% when X% = 1. This is the important point for the following argument 
to work. To summarize the argument up to this point, we now know that at time n 2 , 
each urn u has chosen a color D u such that each time a ball is drawn out of u alone after 
time 712 then it is almost surely of this color. 

Denote by B the number of urns that choose black (b): B = Y, U au l{o u =b} j an d by W 
the number of urns that choose white (tt>): W - Y, U au l{o u =ro}- 

Suppose without loss of generality that there is more urns that choose black than urns 
that choose white, in symbols: B >W . The fact that in case of ties we choose black has 
no importance, as will be seen at the end of the argument. 

Now we need to distinguish two cases for which the end of the proof will be different. 
Let us first give in a few lines an idea of what happens in each of the cases: 

First case: if (1 - p)B > U/2 it means that the majority color in all the U urns 
combined will eventually be black. Urns which choose black shall be conformist urns and 
those which choose white will be nonconformist: 



N C = B and N f = W. 

Second case: if (l-p)B <U/2 (and (l-p)W <U/2 since B > W) then the conformist 
color is not yet decided, and could be either black or white. We will see at the end that 
the equality case (1 -p)B = U/2 easily follows from the proof of the second case. 

Let us start with the proof of the first case. Fix j3 e (1/2, (1 - p)B/U) and denote by 
n 3 the £_i-measurable time: 



n 3 = inf jm > n 2 ■ Vn > m. 
This time is finite a.s. since 



zXn 2 ^u^U J-iO^bM^-l} 



nU 



Td= n2 T,ueU l{0"=b}n{:r«=-l} 

hm — ■ = (1 -p)B U > (5 

Then for any n > n 3 we have: 

Un Un Un 

and therefore for any N >1: 



>/3, 



px 

= E x 



n+N 

n nK=-i}uK=b} 

l=n uiU 



ueU 



xf=-l\u{cf=b] 



G-liF n+N-1 



E a 



n+N 

nni 

. l=n uzU 
n+N-1 

>< n ni 

l=n ueU 



xf=-l\u{cf=b\ 



xf=-l\u{cf=b] 



And on nr^" 1 n u eu {x? = -l} u {c^ = b}: 
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11 Vs^-lM 



ueU 



n+N-l 



- Y\ E * [ 1 {xf=-l}u{cf=b} &-1 > F n+N-l 

= Y\ E * [ 1 {xf=-l} + 1 {x? = l}u{^=b} G-l,Fn+N-l\ 
ueU 

= 11 1 {x?=-l) + 1 {xf=l} EX [ 1 {c-=b} G-l,Fn+N-l\ 



ueU 



~ -'-{xj , =-l} + -L{x?=l 



ueU 



= n i K-i} + 1 {^i}r 



1 



Ul(l-2B*/Ul) 



1 

1 1 1 k=-i} + 1 {^r= 1 ) i + w« • 



Since I > n > n 3 , we have jUl > (3. Therefore 



n 1 {^=-i}u{cr=b} 



G-i,^ 



n+N-l 



a n( 1 («=r-i) + 1 («r-i))T7^ 

= n ! 

= f 1 )" 



Ul(l-2/3) 



By induction it follows that 



n+N 

n nK=-i}uK=b} 



And letting iV -> oo, we obtain: 



n+N / | \Uoo/ | \ [/ 

" + -n( 1+p[ / i( l-2/3)j >0 - 



nnK=-i}u{t?=b} 



oo / J \I7 



Set 



and 



F n =nnK=-i}uK=b}, 

l=n ueU 



f= u ^ = u nnK=-i}u{cr=b>, 

n=ra 3 n=n 3 Z= n uelY 



then by the classical argument we conclude: 

1 F = limE[E[l F |.F n ;0_i]|.F n ] > limE[E[l F J^ n ;^_ 1 ]|^ n ]>r 72 >0, 
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so that F is an event of full probability, which ends the proof of the first case. 

Let us now argue in the second case: suppose that (1 - p)W < (1 -p)B < U/2. 
For this argument, we need the following lemma: 

Lemma 3.12. Fix £ cU a set of urn labels whose cardinality E := \£\ satisfies (1 -p)E < 
U/2. Let Y\,Y2,Y3,--- be a sequence of independent random variables with the following 
law: 

• ifn modUe£, then P[Y n = 1] = 1 - P[Y n = -1] = p < 1/2, 

• if n mod U </£, then P[Y n = 1] = 1. 
Then, 

Vae (0,l-2E(l-p)/U),P[Vn,Y 1 + - + Y n Zan] > 0. 

Set 9" to be the above probability. (Note that 9'' depends on the choice of a.) 

Note that this lemma is also a consequence of the law of large numbers which is to be 
compared with Lemma [3. II (supercritical case) and Lemma [3.41 (critical case). The proof 
is left to the reader. 

Fix n>n 2 and denote by d = m* the majority color in all the U urns combined at time 
n, and by (resp. Df) the number of balls of color D in all the U urns combined (resp. 
in the urn it) at time I. 

We shall now prove that all the balls drawn out of all the U urns combined after time 
n are of color D with a probability uniformly bounded away from 0. 

Denote by £ the set of urns that did not chose the color D, in symbols: 

£ = {u£U:Q u *Q}. 

Then E = \£\ satisfies (1 - p)E < U/2 (this is the hypothesis of the second case of the 
proof). 

For all / > n and u eU, set k = IU + u and 

Yk = ^{xf=l}u{uf£} ~ l{xf=-l}n{ueS} ■ 

Set k± = (n + 1)U, and note that then the sequence Yk 1+ i,Yk 1+ 2,Yk 1+ 3, ... satisfies the 
condition of Lemma 13.121 and is independent of Q\. Set a - 1/2 - ^(l - p)/U (any a e 
(0, 1 - 2E(1 -p)/U) would suffice). Then we have 

P[A] = 9';>0, 

where A = {Y kl+1 + Y kl+2 + ... + Y kl+l > al, V/ > 0}. 
For any > 1 we have: 



'n+N 
l=n uzU 



1 f n+N 

-l}u{cr = c)} T n ,Q_ x > P An f| f] { x 



-i}u{cr = o} 



•T 7 ni Q-l 
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= E 



= E 



n+N 



i a x n n i {^=-i}u{c«=o} 



l=n ueU 
n+N-1 



F n, G-l 



iax n ni{xr-i}u{cr^} E n>:^-iHcr») 



l=n ueU 



ueU 



F n+N-l, G-l 



F n, G-l 



Then on 



n+N-l 

n nw=-i}uK=5} 



l=n ueU 



we have: 



n i {^ +N =-i}u{^ +N =v} 



ueU 



J~\ n+N-l, G-l 



- u4 

ueU 

- u4 

ueU 



1 te,„=-i) + Mx u 



J~\ n+N-l, G-l^ 



l\nU".„=*\\Fn+N-l 



- n Hxi +N =-i) + Hk +n =i} e [ H<z +N =*} 

ueU 



n+N-l 



Then on 



we have: 



n+N-l 



An H PI K = -1} " K = h{C, = 5}, 



1 



1 + p U(n+N)-2D* 
1 



-at/iV ' 



Then: 



n i {< +J v=- i ) u {Civ= a } 



n+N-l, G-l 



" Jl ( 1 R +JV =-l} + 1 R +JV = l} ! + p -a£/7V ) 
- n ( 1 R +iv =-l} + 1 R +iv =l} ) 1 + p -aUN 



HIT 



ueU 



-aUN 



- 1—*—)" 



Therefore by induction: 
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n+N 

n nw=-i}u{cr=f} 



> A? 



°° / i \ u 



Let iV go to infinity: 



nnK=-i}uK=3} 



:= 7/3 > 0. 



We can now conclude by the same argument that we used several times before. Set: 

oo 

f n =nnK=-i} u K=3}, 

and F = U~„ 2 F n- We have: 

lp = lim E [ E [ 1 F | JT n) ^]| JT n ] > hm E [E [ 1 F J ^_i]| .F„] > % > 0. 

neoo neoo 

Then P[F] = 1 which ends the proof of the second case. 

Let us conclude this discussion with the case of equality (1 -p)B = U/2. Since W < B 
and p > we have: 

U> (1 -p)U = (l-p)B + (l-p)W = U/2 + (l-p)W 

and then (1 - p)W < U /2. Using the proof of the second case, it follows that for each 
time n>ri2 such that the majority color at time n is black, there is a positive probability 
bounded away from that all the balls drawn out of all the U urns combined after time n 
are black. Therefore it suffice to prove that after n 2 there is infinitely many times n such 
that black is the majority color, m* = b. Now note that: 

n n 

b: - w* = b* 2 _ x - w T u + y, E kef-,} - i { c f - b} < b: 2 _, - w: 2 _, + E E (^r - w) > 

I=n2 u<=U l=U2 ueU 

where = {X" = -1 and d u = b}. The last sum is a zero-drift random walk on Z: 



E ^- A Y ~ ^- A f c 



uelt 



-U + 2 £ l Ar 



= -U + 2xBxp[XJ l = -l] = -U + 25(1 - p) = 0. 



Therefore it becomes positive infinitely often. This proves that after a finite time, all the 
balls drawn out of all the U urns combined are black. □ 
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3.5 Graphical summary 

We can now summarize the three cases in a single (U,p) diagram. According to the 
Conformism Equation ( ICE)) , when p < 1/2, the interface between different phases are 
given by the straight lines U = 2(1 -p)N^ with Nj. = 1, 2, 3... 

U 4 




Figure 7: Summary of different cases depending on p and U. 



Take for example U = 7 (cf. the dashed horizontal line) then 

• if p e [0,1/8] there is at most three nonconformist urns (and there is actually a 
positive probability that Ni = i for each i = 0, 1,2 or 3); 

• if p € (1/8,3/10] there is at most four nonconformist urns; 

• if p e (3/10,5/12] there is at most five nonconformist urns; 

• if jo € (5/12, 1/2) there is at most six nonconformist urns; 

• if p € [1/2, 1] there is no nonconformist urns. 

4 Two generalizations 

4.1 Extension to more than two colors 

Let us now consider what happens if there are more than two colors available. Define CC = 
(f i 5 1)2? • • • ,$c) the set of C possible colors, with CeN. The Interacting Urns Mechanism 
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with C > 2 colors is just the natural generalization of the C = 2 case. The probability to 
draw a ball of color 9j from an urn that contains Nj balls of color Dj for 1 < j < C, equals: 

Ei=i w Nj 

Claim: Theorem 13.21 (supercritical case), Theorem l3. 51 (critical case). Proposition |33] and 
Theorem 13.101 (subcritical case) are still true when C > 2. 

If p < 1/2 an X-suitable Urn Path in the case C > 2 can be schematically represented as 
follows: 




conformist urns nonconformist urns 



Figure 8: Schematic representation of an X-suitable Urn Path when C > 2. 



Let us justify briefly the claim and then explain how to adapt the proofs so that they 
work with C > 2. 

In the case of two colors we used arguments of the following form: "Consider the 
majority color at time n, and prove that there is a positive probability uniformly bounded 
away from that after time n we draw only this color". But let us think about what 
the term "majority color" means in our particular settings. In politics, for instance in a 
parliament, a majority could be absolute or relative. In the first case, it means "having 
more than 50% of the seats" whereas in the second it only means "having more seats than 
any other group". In the context of our proof, the relevant interpretation is the second: 
what matters is that a certain color has more balls than any other color. 

For example, consider the two following configurations for a single urn with two colors: 

i) n=10and (B 10 , W w ) = (9, 1) ; 

ii) n = 1000 and (B woo , W WO o) = (505,495). 

Then the probability for the black to win is larger in the second case (B -W = 10) than 
in the first one (B - W = 8). The information that the proportions are (90%, 10%) in the 
first case and (50.5%, 49.5%) in the second is not relevant. 

This finding is important since, for C > 3, there is not necessarily a color with absolute 
majority, but there will always be at least one color with relative majority. Let us take for 
example the case of one single urn with three colors, and suppose without loss of generality 
that the majority color is Di, that is, N\ > N 2 and N% > N 3 . Then the probability to draw 
only balls of color Di starting from this configuration is: 



°° r>Nl+i 00 1 oo 1 oo -| 

p=u — = n >n — - — = n — - — 

u p Ni+i + p N2 + p Ns a i + p^-^ + p^-^-i - i = i i + p -i + p -i ii i + 2p -i 



>0. 
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If there were C colors instead, we would have had: 



^n T7T c- TF? >o 

In other words, all our draw-the-majority-color-with-positive-probability arguments in 
the last section still work and all the results are still true. 

4.2 Extensions to a wider class of reinforcement weight sequences 

Let us consider the following hypothesis about the reinforcement weight sequence: 

liminf — ^ > I. (H{) 

Claim: Theorem 13.21 (supercritical case), Theorem 13.51 (critical case), Proposition 13.91 
and Theorem 13.101 (subcritical case) are still true under (\Hi\) . 

We can immediately make two remarks about this hypothesis: 

i) The exponential reinforcement with p > 1 satisfies fliJiD : 

pi+i 

lim inf — — = lim inf p = p > 1 

z— >oo p 1 2— >oo 



ii) Any reinforcement weight sequence that satisfies flijiD satisfies (ISRHp . 



Under flijiD , and for a,b> I and a > b, we get a lower bound for the quantity %(a,b): 

w a 11 1 



W a + W b 1 + ^-1 + -JSLp 1 + pb-a ■ 

The last quantity corresponds to the exponential reinforcement. This inequality can be 
used in the arguments each time we need a lower bound on 7r(a, b), and allows us to finish 
the proofs just as in the exponential case. Note that this lower bound is true only if a > b, 
but it is sufficient since we only use n(a,b) when a is already the number of balls of the 
majority color. 

5 Conclusion 

A natural follow-up to the results of this paper is to search for the distribution of the 
number of nonconformist urns. That is, answering the question "What is the value of 

P [Nf = i] 

for i < £7/2(1 - p)T' This seems to be a difficult question. Another natural question is 
to wonder what happens if the reinforcement sequence is strongly but not exponentially 
reinforced, for example if it grows only polynomially. 
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We can actually conjecture that under ( 1SRH|) a Reinforced Urn Process can behave in 
two different ways: either it behaves as the exponentially reinforced urn processes (which 
means that Theorem 13.21 (supercritical case), Theorem 13.51 (critical case), Proposition 13.91 
and Theorem 13.101 (subcritical case) are true) or all the urns draw the same color after a 
finite time, whenever p > 0. Roughly speaking, either the reinforcement sequence is strong 
enough to allow individual urns to have some independence for being nonconformist, or 
all the urns eventually have to give in to the majority color. It also seems natural to 
conjecture that polynomial reinforcements behave in the second way. It is actually easy 
to see that they could not behave as the exponential reinforcements. 

It turns out that already proving that all the urns eventually draw the same color in 
the case p = 1 and w general, that is when the U urns behave just like one big urn with 
U draws at each step, is not entirely trivial. This work is in progress and shall be the 
subject of a forthcoming paper. 

When we study reinforcement processes it is natural to wonder if there is a natural 
way to say that one reinforcement sequence is stronger than an other one. In other words, 
is there a natural way to put an order < over the set of reinforcement sequences? The 
(ISRHI) gives a first rough answer dividing this set in two, depending on whether the sum 
of inverses is finite or not. The results of this paper allows us to split again the set 
of strongly reinforced sequences in two parts: those that satisfy Theorem I3.2[ Theorem 
13.5} Proposition 13.91 and Theorem 13.101 and those that do not. It would be interesting 
to know if this splitting could be expressed in a natural way independent of Interacting 
Urns Models as (ISRHD do. And could this splitting have a meaning in other reinforced 
processes as for example, in the context of Reinforced Random Walks? 

Acknowledgments. I would like to thank my Ph.D. advisor, Vlada Limic, for many 
insightful discussions about this work as well as detailed comments on earlier drafts. 
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